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ABSTRACT 


Systems  which  are  composed  of  two  or  more  phases,  or  subsystems, 
arranged  in  logical  sequence  are  found  frequently  in  industry  and 
defense.   Standard  procedures  for  computing  lower  confidence  limits 
on  reliability  of  such  systems  rely  on  the  use  of  system  data* 
Engineering  changes  to  any  of  these  subsystems  can  effect  the  invali- 
dation of  all  existing  data,  necessitating  additional,  sometimes 
extensive,  testing.   Such  changes  are  not  infrequent  in  complex  sys- 
tems.  A  need  exists  for  a  method  of  computing  lower  confidence  limits 
on  reliability  which  uses  phase  data.   Some  approximation  techniques 
have  become  available.   One  such  technique  is  currently  being  used 
by  Applied  Physics  Laboratory,  The  Johns  Hopkins  University.   Computer 
simulation  techniques  are  used  to  analyze  the  accuracy  of  this  pro- 
cedure. 
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CHAPTER  I 
INTRODUCTION 

Current  technology  has  produced  a  class  of  systems  which  are  com- 
posed of  two  or  more  phases,  or  subsystems,  arranged  in  logical  sequence, 
such  that  the  success  of  the  system  depends  upon  the  success  of  the 
component  phases.   Thus  the  reliability  of  the  system,  R  ,  depends  upon 
the  reliability  of  each  of  the  k  phases  of  which  it  is  composed.   We 
express  this  mathematically  as  follows: 

k 
R  =  n  R.  (1) 

S   1-1   X 

where  R.   is  the  reliability  of  the  i   phase.   Standard  statistical 
procedures  used  to  compute  lower  confidence  limits  (LCL)  on  R 
require  the  use  of  system  test  data.   Whenever  high  degrees  of  reli- 
ability, at  high  confidence  levels,  are  demanded  of  a  system,  extensive 
testing  is  required,  frequently  at  considerable  cost. 

Engineering  changes  to  any  one  of  the  phases  may  cause  the  invali- 
dation of  all  previous  system  test  data.   There  is  a  need  for  a  pro- 
cedure to  construct  lower  confidence  limits  on  system  reliability  using 
phase  test  data  which  will  salvage  as  much  of  the  data  as  possible. 

Approximation  procedures  are  becoming  available  for  so  constructing 
these  LCL's,  one  of  which  is  currently  being  used  by  Applied  Physics 
Laboratory,  The  Johns  Hopkins  University.   This  procedure  is  discussed 
in  [ll.1 

The  purpose  of  this  paper  is  to  analyze  the  accuracy  of  this  pro- 
cedure.  Computer  simulation  techniques  will  be  used  to  accomplish 
this  analysis. 


lumbers   in  brackets   refer   to   items   in   the  bibliography  with   the 
same  number. 


CHAPTER  II 
COMPUTATIONAL  PROCEDURE  EMPLOYED  BY  APPLIED  PHYSICS  LABORATORY 


The  APL  method  for  constructing  LCL's  on  R   assumes  the  following: 

a)  mutually  independent  trials 

b)  the  distribution  of  the  reliability  estimator,  R  ,  is 

s 

normal. 

The  formula  for  computing  the  100(l-a)%,  one-sided  LCL,  R^  ,  is 

^  =  Rg  -  P(l-a)  •  o-  (2) 

s 

where  R   is  the  system  reliability  estimator,   P(l-a)   is  the 

100 (1-a)  percentile  of  the  standard  normal  distribution,  and  8~        is 

R 
s 

the  standard  deviation  estimator  for  the  R   distribution 

s 

k 
R  =  n  R.  (3) 

S   i-1  X 

where  R.   is  the  phase  reliability  estimator  and  is  defined  by 

R.  =  s./n.  .  (4) 

ill 

That  is,   R.   denotes  the  proportion  of  successes  for  the  i   phase, 

s.,   out  of  n.   trials. 
l  l 

The  value  o^   is  computed  by 
R 
s 


al    =  n  r.  -  n 

R    .  ,   i    .  t 

s    1=1        1=1 


i.  -  v"v 


i     n.  -  1 


(5) 


which  is  an  unbiased  estimator  of  the  variance  of  R  .   Standard  devia- 

s 

tion,   a-  ,   is  obtained  by  extracting  the  square  root  of  the  variance. 
R 
S 

Although  biased,  this  estimator  is  considered  to  be  sufficiently  close 

tO   0£    [1]. 
s 
As  stated  above,  one  basic  assumption  of  the  model  is  that   R 

is  a  normally  distributed  random  variable.   As  an  ancillary  result  of 
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the  simulation,  this  assumption  was  verified  for  those  cases  for  which 
the  procedure  was  reasonably  accurate.   For  each  case  considered,  1000 
values  of  R   were  computed  and  plotted  on  normal  probability  paper. 
For  one  such  example  see  Figure  1.   For  those  cases  which  proved  less 
accurate,  the  distribution  departed  from  normal. 
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CHAPTER  III 
THEORY  OF  THE  SIMULATION  TECHNIQUE 

One  standard  interpretation  which  can  be  applied  to  the  meaning  of 
a  lower  confidence  limit  involves  the  method  used  to  compute  it.   This 
says  that  regardless  of  the  true  value  of  R   the  computation  will 
produce  an  LCL,   R.  ,  which  is  less  than  R    (l-a)%  of  the  time.   Use 
can  be  made  of  this  interpretation  in  formulating  the  simulation  model. 

If  one  were  to  use  an  exact  method  of  determining  R   and  repeated 
the  process  several  times,  he  could  expect  that  approximately  (l-a)% 

of  the  values  would  be  less  than  R  .   As  the  number  of  replications 

s  r 

approaches  infinity,  he  could  expect  that  exactly  (l-a)%  of  the  values 

would  be  less  than  R  . 

s 

One  could  use  a  similar  approach  to  evaluate  the  accuracy  of  an 
unproven  method.   Given  a  hypothetical  system  of  known  R.,   and  hence 
known  R  ,   one  could  use  the  proposed  method  to  compute  R_   on  R  . 

S  Li  S 

If  the  method  was  accurate,  approximately  (l-a)%  of  the  values  so  com- 
puted would  be  less  than  R  .   If  the  number  of  replications  was  suf- 
ficiently large,  the  percentile  of  R_   which  is  less  than  R   would 
be  a  good  measure  of  the  accuracy  of  the  procedure.   This  percentile 

will  be  denoted  A- 

1-a 

The  computer  simulation  technique,  used  herein,  follows  the  above 

approach.   The  rapid  computational  ability  of  the  computer  allows  one 

to  simulate  the  testing  process,  compute  iL  ,   and  replicate  the  process 

a  great  many  times.   One  of  our  measures  of  effectivess  of  the  method 

will  be  the  relative  closeness  of  A..     to  R  .   Other  measures  of 

1-a       s 

effectiveness  will  be  discussed  in  the  results  section  of  this  paper. 
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The  simulation  technique  begins  by  reading  from  data  the  parameters 
of  the  case  to  be  considered;  i.e.,  KK,  the  number  of  replications  de- 
sired (1000  for  all  cases  considered  herein) ;   K,  the  number  of  phases 
per  system;   R.   and  n.   for  all  phases;  and  a.   Using  a  pseudo-random 
number  generator   and  the  known  phase  reliabilities,  test  data  is 
gathered  on  each  of  the  phases  by  comparing  n.   random  numbers  with 
R.   (i  =  1,  2  ,  .  . .  ,  K)  .    Each  time  the  random  number  generator  pro- 
duces a  number  less  than  or  equal  to  R„   it  is  counted  as  a  successful 

n         l 

test.   A  running  total  of  successes,   s.,   is  kept  throughout  the  course 
of  testingo   After  having  so  obtained  these  data,  SUBROUTINE  RHAT  is 
called  with  parameter  a.   The  values   s.   and  n.   are  made  available  to 
RHAT  via  the  DIMENSION  statement.   SUBROUTINE  RHAT  returns  the  values 
R^   and  R  .   This  operation  is  repeated  for  KK  replications  to  compute 
KK  values  of  iL   and  R  .   These  values  are  stored  in  vector  matrices 
for  later  use. 

SUBROUTINE  RHAT  is  a  relatively  straightforward  application  of  the 
working  formulae  contained  in  Chapter  2.   One  point  worthy  of  note  is 
that  only  ten  values  of  P(l-a)  have  been  read  into  computer  memory  in 
order  to  conserve  memory  space.   The  argument  (1-a)  is  digitized  to 
facilitate  stowage  and  retrieval.   This  limits  the  values  of  a  which 
can  be  used  to  increments  of  .05,  from  .05  to  and  including  .50,  a 
limitation  which  can  easily  be  changed  as  the  requirements  dictate. 


2The  pseudo-random  number  generator  used  herein  is  a  library  sub- 
routine of  the  Computer  Facility,  Naval  Postgraduate  School,  Monterey. 
A  printout  of  this  subroutine  is  included  in  Appendix  II. 

3The  reader  is  invited  to  follow  the  program  logic  by  referring  to 
Appendix  II.   Extensive  use  is  made  of  comment  cards  to  explain  the 
operations  as  they  are  accomplished.   The  program  notation  is  intended 
to  be  the  same  in  meaning  as  that  of  the  body  of  the  paper.   It  is,  of 
necessity,  somewhat  different  in  form  because  of  machine  limitations. 
As  an  aid,  a  glossary  of  terms  is  provided  in  Appendix  I. 
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As  the  above  values  of   IL   are  generated,  they  are  summed  for 
eventual  division  by  KK  to  compute  their  mean. 

Thus  far,  the  simulation  has  performed  the  following  operations: 

1)  generated  the  statistics   s„   (i  =  1,  2 ,  3 ,  . . . ,  K) 

2)  computed  the  values  for  the  R  ,   IL   and  Al  matrices 
(Al  being  an  exact  duplication  of  the  lL   matrix) 

3)  summed  the  values  of   R   to  get  the  mean,   p- 

L  RL 

Next,  a  sorting  routine,  SUBROUTINE  SHSORT,4  is  called  for  the 

purpose  of  putting  matrices   R   and  Al   into  ascending  numerical 

order.   This  is  done  to  facilitate  plotting  these  values  on  probability 

graph  paper  to  determine  their  distributions.   This  also  facilitates 

obtaining  the  lOO(l-a)  percentile  of  the  IL   distribution,   A-   . 

Recall  the  matrix  Al  was  identical  to  the  matrix  IL   before  it  was 

ordered.   Thus,   An    equals  the  KK(l-a)   member  of  the  ordered  Al 

1-a 

matrix. 

Next,  the  percentile  of  R^   which  is  less  than  R   is  obtained; 
i.e.,  the  probability  IL   is  less  than  R  ,   denoted  P(R  ).   This  is 

J_i  s  s 

computed  by  determining  the  last  element  of  the  ordered  Al  matrix 
whose  value  is  less  than  or  equal  to  R   and  dividing  its  index  number 
by  KK. 

The  variance  of  ]L  ,   o~2,   is  calculated  next  by  summing  the 

\  L 

squared  differences  of  IL   and  \i-        and  dividing  by  KK,  the  number  of 

X        RL 

replications, 


KK 

I 

i=l 


L(\-\> 


KK 


^This  subroutine  is  a  library  subroutine  of  the  Computer  Facility, 
Naval  Postgraduate  School,  Monterey,  Calif,   It  is  printed  out  in 
Appendix  II. 
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The  square  root  is  later  extracted  to  obtain  the  standard  deviation, 


V 


The  difference  between  R   and  An     is  then  obtained,  which  is 

s        1-a 


the  primary  measure  of  effectiveness  of  the  procedure. 

The  remaining  statements  are  editorial  in  nature;  e.g..,  input/output 
statements  which  read  in  data  or  printout  results.   Others  initialize 
variables,  sums,  or  products  to  ensure  that  values  are  not  carried  over 
from  replication  to  replication. 

The  program  output  may  be  summarized  as  follows: 

a)  1000  values  of  system  reliability  estimator,   R  ,   in 
ascending  numerical  order 

b)  1000  values  of  LCL,   R  ,   in  chronological  order 

c)  1000  values  of  LCL,   R  ,   in  ascending  numerical  order 

d)  system  reliability,   R 

e)  100 (1-a)  percentile  of  the  population  of  IL   population, 

1-a 

f)  standard  deviation  of  R\.   population,   a~ 

L  *L 

g)  probability  that  iL   is  less  than  R  ,   P(R  ) 

l_i  s        s 

h)   mean   of  R  ,   y- 

L    *L 

i)   the  difference  between  R   and  A. 

s        1-a 

j)   Zn.q.,   a  measure  of  the  amount  of  testing  done  and  the 
unreliability  (q.),  or  failure  rate 
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CHAPTER  IV 
SIMULATION  RESULTS 

The  accuracy  of  the  procedure  is  measured  by  the  closeness  of  A., 

1-a 

relative  to  R  .   A  second  measure  of  effectiveness,   P(R  ),   the 
s  s 

probability  that   R^   is  less  than  R  ,   provides  a  measure  of  the  true 

confidence  level  achieved  by  using  this  procedure.   If  the  method  were 

exact,  one  could  expect  A    to  equal  R   and  P(R  )   to  equal   (1-a). 

In  addition  to  the  above  criteria,  the  mean  of  R\.  ,   y-  ,   and  the 

X    \ 
standard  deviation,   o^  ,   are  also  provided  as  measures  of  effective- 

*L 
ness.   These  two  characteristics  provide  a  measure  of  the  likelihood  of 

the  procedure  producing  a  lower  confidence  limit  which  differs  consid- 
erably from  R  .   It  can  be  shown  that  for  those  cases  for  which  the 
s 

procedure  is  reasonably  accurate  the  distribution  of  iL   is  approxi- 
mately normal,   (See  Figure  2.)   Thus  if  the  procedure  is  accurate,  one 
should  expect  to  find  the   1-a  percentile  to  be  a  known  function  of 
the  mean;  e.g.,  the  90   percentile  should  be  approximately  1.28  stand- 
ard deviations  above  the  sample  mean.   In  addition,  the  mean  and  vari- 
ance can  be  used  to  construct  prediction  regions  into  which  R^   is 
likely  to  fall,  assuming  again  that  lL   is  normally  distributed. 

Several  cases  were  examined  in  evaluation  of  this  method.   In  each 
case  one  or  more  of  the  parameters,   K,   R.,   n„ ,  were  changed.   In 
addition,  each  case  was  run  for  a-values  equal  to  .05,  .1,  and  .2, 
successively,,   The  results  of  these  cases  are  tabulated  in  Tables  I 
through  III. 

The  accuracy  of  reliability  testing  procedures  is  most  often  a 
function  of  the  amount  of  testing,   n„ ,   and  the  unreliability  of  the 
subsystems,   q..   This  quantity  is  also  tabulated  in  Tables  I  through 
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K 
III  and  is  expressed  by   £  n.q.  .   Thus  Tables  I  through  III  provide 

i=l   X  X 
criteria  upon  which  one  can  judge  the  accuracy  of  the  procedure  and  an 

effective  measure  of  when  to  expect  this  accuracy.   If  one  knows  the 
reliabilities  for  which  he  is  striving  and  the  amount  of  testing  which 
is  economically  feasible,  he  has  available  a  good  estimate  of  the 
accuracy  of  this  procedure. 

The  cases  considered  are  tabulated  in  three  separate  tables  ac- 
cording to  the  purpose  for  which  they  were  considered.   Cases  1  through 
24,  Table  I,  are  the  same  as  those  considered  by  Woods  and  Borsting  [2] 
and  are  intended  to  provide  a  direct  comparison  with  their  method. 
Table  III  contains  a  "family"  of  cases  in  which  only  the  parameter  n, 
changes.   These  cases  demonstrate  how  the  accuracy  criteria,   A     and 
P(R  ),   behave  as  a  function  of  the  amount  of  testing.   Figures  3 
through  8  graphically  illustrate  the  behavior  of  the  accuracy  criteria 

as  a  function  of   En.q.   for  the  cases  considered  in  Tables  I  through 

11 

III.   Each  of  these  graphs  utilizes  one  of  the  three  a-levels  considered, 
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CHAPTER  V 
CONCLUSIONS 

Based  upon  the  results  of  the  simulation,  which  are  tabulated  in 
Tables  I  through  III  and  illustrated  in  Figures  3  through  8,  the  fol- 
lowing general  conclusions  can  be  drawn: 

a)  The  accuracy  of  the  method  is  a  function  of   Zn.q.   and,  in 

general,  will  increase  as  this  value  increases.   However,  the 

graphs  of  the  accuracy  criteria  take  the  shape  of  a  sawtooth 

curve.   Therefore,  there  is  no  guarantee  that  increasing   En.q 

will  improve  the  accuracy  of  the  method.   It  is  generally  true, 

however,  that  as   Zn.q.   gets  large  the  difference  between 

ii 

system  reliability,   R  ,   and  A     should  converge  to  zero, 
as  should  the  difference  between  the  desired  confidence  level, 
(1-a),   and  P(R  ). 

b)  At  confidence  levels  of  .9  and  .8,  and  for  values  of   En.q. 

ini 

which  are  sufficiently  high,  the  procedure  appears  to  be  rea- 
sonably accurate.   Obviously,  the  numerical  value  of  "suffi- 
ciently high"  is  subjective  and  depends  upon  such  unknown  param- 
eters as  user  risk,  utility,  etc.   For  most  purposes,  a  value 
of   Zn.q.  ~  4.0   should  be  sufficiently  high  at  both  of  the 
above  confidence  levels.   The  procedure  appears  to  be  inaccu- 
rate if  R   is  very  high  or  Zn.q.   is  small  enough  to  make 
a  failure  only  moderately  probable. 

c)  Serious  doubt  exists  as  to  the  acceptability  of  the  method  for 
a  confidence  level  of  .95  or  greater.   At  the  former  two  con- 
fidence levels  there  was  an  apparent  convergence  toward  zero 
error.   No  such  convergence  was  apparent  at  the  .95  level. 
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Even  in  Cases  6  and  8,  where   Zn.q.   was  22.0  and  23.9, 

11 

respectively,  the  difference,   R  -  A.   ,   is  an  order  of 
r       J  s    1-or 

magnitude  greater  than  the  corresponding  values  for  a  =  .1 
and   a  =  .2.   Similarly,  the  actual  confidence  level  is  about 
half  of  that  intended. 
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APPENDIX  I 
GLOSSARY 


Meaning 

System  reliability 

Phase  reliability 

System  reliability  estimator 

Phase  reliability  estimator 

Successful  tests  of  the  i   phase 

Number  of  tests  of  the  i   phase 

Estimator  for  the  variance  of  the 
reliability  estimators 

Estimator  for  the  standard  deviation 
of  reliability  estimators 

Computed  lower  confidence  limit 

The  (1-a)    percentile  of  the 
computed  R_ 


Probability   that  IL    is   less   than 


R 


.vth 


The  (i)    percentile  of  the  standard 
normal  distribution 

Mean  of  the  LCL's  generated 

Variance  of  the  LCL's  generated 

Standard  deviation  of  the  LCL's 
generated 

Number  of  replications  per  case 

Number  of  phases  per  case 


Computer  Simulation 

Notation 

Variable  Name 

R 
s 

RSUBS 

R. 

1 

RSUBI(I) 

R 
s 

RHATS 

R. 

1 

RHATI 

s  . 

1 

S(I) 

n. 

l 

AN(I) 

5S2 

SIGPSQ 

R 

E 

\ 

A 


1-a 


P(Rs) 
P(i) 


h 

Of  2 


\ 

KK 

K 


SIG 

RHATL 
A1A 

RSPCN 
P(D 

MEAN 

VAR 

SIGMA 

KK 

K 
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APPENDIX  II 

PROGRAM  PRINTOUT 

PROGRAM  MAIN 
C 
C 

C         PROGRAM  MAIN  DOES  ALL  COMPUTATIONS  EXCEPT 
C         THE  COMPUTATION  OF  THE  VALUES  RHATS,  SYSTEM 
C         RELIABILITY  ESTIMATOR,  AND  RHATL,  LOWER 
C         CONFIDENCE  LIMITS.   THESE  LATTER  COMPUTA- 
C         TIONS  ARE  DONE  IN  SUBROUTINE  RHAT 
C 
C 
C 
C 

C         HERE  SET  INDEX  OF  RANDOM  NUMBER  GENERATOR 
C 

XXX*RNG(C) 

XXX«RNGU51) 
C 

c 

C  HERE  SET  ALL  SUBSYSTEM  PARAMETERS  AND  TEST 

C  STATISTICS  TO  ZERO  TO  AVOID  CARRYING  VALUES 

C  OVER  FROM  ONE  CASE  STUDY  TO  THE  NEXT. 
C 

do  p  j«i,ior 

P< J)=G. 
AN(J)  =0. 
S( J»»0. 

9  CONTINUE 
C 
C 

C         HERE  READ  INTO  MEMORY:   NUMBER  OF  REPLI- 
C         CATIONS  DESIRED;   NUMBER  OF  SUBSYSTEMS  CON- 
C         SIDERED;   ALFA  LEVEL;   RELIABILITY  AND  NUM- 
C         BEP  OF  TESTS  FOR  EACH  SUBSYSTEM. 
C 

PEAD(5,900)KK,K.ALFA,  (   R(J>,AN(J),  J=1,K) 
9C0  FORMAT  1211ft  Fl0.5,/<  2F10.5M 
C 
C 

C         HERE  READ  INTO  MEMORY  TEN  VALUES  OF  STAND- 
C         ARD  DEVIATION  OF  (1-ALFA)  PERCENTILE  OF  t 
C         STANOARD  NORMAL  DISTRIBUTION. 
C 

P(l)«1.645 

P<2  -I.2816 

P(3)«1.038 

P<4)».8416 

P<5)*.675 

P(6)=.525 

P(7J«.385 

P<8)*.253 

P<9)«.124 

P(10»«.0 

BK*KK 
C 

c 

C         HERE  INITILIZE  THE  VALUES  OF  ALL  CUMULA- 
C         TIVE  SUMS  AND  PRODUCTS  TO  ZERO  AND  ONE, 
C         RESPECTIVELY. 
C 

RSUBS-1. 

DO  2C  J*1,KK 

RHATLUI  *C. 
2C  CONTINUE 

PMU«  0. 

SUM«  0. 

SUMA  «  0. 
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C         HERE  COMPUTE  SYSTEM  RELIABILITY,  THAT  IS 
C         THE  PRODUCT  CF  ALL  SUBSYSTEM  RELIABILITIES. 
C 

TO  5C  17  =  1, K 
RSUBS=RSUBS*R( IZ) 
50    CONTINUE 
C 

c 

C         HERE  COMPUTE  THE  SUM  OF  PRODUCTS 

C  (  Nil)  X  0(11  I.  THE  AMOUNT  OF  TESTING 

C         TIMES  THF  SUBSYSTEM  UNRELIABILITY,  FOR 

C  ALL  SUBSYSTEMS, 

C 

DO    45C    JR  =  1  ,K 

SUMA    =     (AN(JR)*(1.-       RURm+SUMA 
430    CONTINUE 
C 
C 

C         HERE  BEGIN  GATHERING  TEST  DATA  FOR  EACH 
C  PF  KK  REPLICATIONS. 

C 

DO  100  IX=1,KK 
C 
C 

C         HERE  SET  THE  VALUE  SU),  THE  NUMBER  OF 
C         SUCCESSFUL  TRIALS.  TO  ZERO  FOP  EACH  SUB- 
C  SYSTEM.   BEGIN  TESTING. 

C 

CO  10  J  =  1  ,  K 

S( J)=0. 
10  CONTINUE 

DO  20C  IA=1,K 

NIA=AN( IA) 

DO  2C0  IB=1,NIA 
C 
C 

C         HERE  COMPARE  AN(IA)  RANDOM  NUMBERS  TO 
C         RELIABILITY  OF  THE  <IA>TH  SUBSYSTEM, 
C  AN(IA)  BEING  THF  NUMBER  OF  TESTS  DESIRED 

C  FOR  THE  (IA)TH  SUBSYSTEM.   IF  THE  PANDOM 

C  NUMBER  IS  EQUAL  TO  OR  LESS  THAN  SUBSYSTEM 

C         RELIABILITY  A  SUCCFSSFUL  TEST  IS  COUNTED. 
C 

IF  (   R( IA)-RNG(! ) )  202,199,199 

199  SI IA)=S( IA)*1. 

200  CONTINUE 
C 

C 

C  HERE  CALL  SUBROUTINE  'RHAT«  WHICH  COMPUTES 

C  THE  LOWER  CONFIDENCE  LIMIT   FOR  THE  TEST 

C  STATISTICS  GATHERED  ABOVE.   THE  LOWER  CON- 

C  FIDENCE  LIMIT  IS  RETURNED  AND  STORED  IN 

C  TWO  DIFFERENT  VECTOR  MATRICES  •RHATL1  AND 

C  'Al«  FOR  FURTHER  COMPUTATIONS.   THEY  ARE 

C  ALSO  SUMMED  FOR  LATER  COMPUTATION  OF  THEIR  MEAN 

C  SUBROUTINE  «RHAT»  ALSO  RETURNS  KK  VALUES 

C  OF  THE  SYSTEM  RELIABILITY  ESTIMATOR  'RHATS1. 

C  THESE  VALUES  ARE  ALSO  STORED  IN  A  VECTOR 

C  MATRIX  FCR  LATER  PRINTOUT. 


C 


CALL  RHAT(ALCA,PHIH,CAPA) 
FHATL(IX)=PHIH 
PHATS(IX)=CA°A 
A1(IX)=RHATL<  IX) 
PMU=PMU«-RHATL(IX) 
1C?  CONTINUE 
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C         HERE  THE  LOWER  CONFIDENCE  LIMIT  MATRIX  AND 
C         THE  SYSTEM  RELIABILITY  ESTIMATOR  MATRIX 
C         ARE  SORTED  INTO  ASCENDING  ORDER  OF  THEIR 
C         VALUES. 
C 

CALL  SHSORT(Al.A2,KK) 

CALL  SHSORT(RHATStCAPl,KK) 
C 
C 

C         HERE  DIVIDE  ACCUMULATED  SUMS  OF  LOWER  CON- 
C         FIDENCE  LIMITS  BY  THE  NUMBER  OF  REPLICA- 
C         TIONS  TO  COMPUTE  THEIR  MEAN. 
C 

MEAN=PMU/BK 
C 
C 

C         HERE  COMPUTE  THE  VALUE  »KALFA»  THAT  IS 
C  (  1  -  ALFA  )  X  THE  NUMBER  OF  REPLICATIONS. 

C         THIS  VALUE  IS  USED  AS  THE  INDEX  NUMBER  OF 
C         THE   ORDERED  LOWER  CONFIDENCE  LIMIT  MATRIX. 
C         THUS  Al(KALFA)  IS  THE  (l-ALFA)TH  PERCENTILE 
C         OF  THE  LOWER  CONFIDENCE  LIMIT  DISTRIBUTION. 
C 

AALFA  =  U.-ALFA)*BK 

KALFA=AALFA 

A1A=A1 (KALFA) 
C 
C 

C         HERE  COMPUTE  THE  PERCENTILE  ASSOCIATED  WITH 
C         R  SUB  S  IN  A  WAY  SIMILAR  TO  THE  METHOD 
C         DESCRIBED  ABOVE. 
C 

FSTaPSUBS 

DO  4G0  IC=1,KK 

IF(RST-A1  (ICM  398,390,399 

398  KIC=IC-1 
FIC=KIC 
RSPCN  =PIC/BK 
RST=1.1 

C 

C 

C         HERE  COMPUTE  VARIANCE  AND  STANDARD  DEVI- 

C         ATION  OF  THE  LOWER  CONFIDENCE  LIMIT  DISTRIBUTION, 

C 

399  NUM=RHATL(IC»-MEAN 
NUMSQ=NUM*NUM 
SUM=SUM«-NUMSQ 

400  CONTINUE 
VAR  =  SUM/BK 
SIGMA  =  SORT(VAR) 

C 

C 

C         HERE  COMPUTE  THE  VALUE  RSUBS  -  A  SUB(l-ALFA). 

C 

DIFF  =  RSUBS-A1A 
C 
C 
C         HERE  PRINT  OUT  ALL  DESIRED  VALUES  ANO  RESULTS. 


C 


WRITE(6,101CI 
WRITE(6,1011MJ,AN(J),       R(JltJ»ltKI 

WRITE<6,1002)RSUBS 

WRITE(6,10C3)A1A 

WRITE(6,lGf 4)SIGMA 

WRITE(6,1005)RSPCN 

WRITE(6,1006)MEAN 

WRITE<6f1023)DIFF 

WRITE(6,1G24)SUMA 

1023  F0RMAT(/////10X,»R  SUB  S  -  A  SUB<1-ALFA)  EQUALS', 
♦F15.5) 

1024  F0RMAT(/////10X, 'SIGMA  (N(I)  X  0(D)  EOUALS  « ,  FJ  5.  5  ) 
1010  F0RMAT(1HI,38X,«I  M2X,«NII  »•  ,  9X,»R(IP//) 
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1011    FORMAT(38X,  12 ,F15 .0 , F 15.3  ) 

1001  FORMAT  (/////(10X.5F15.5) ) 

1002  FORMAT  </////10X,»R  SUB  S  (SYSTEM  RELIABILITY)', 
*•  EQUALS' ,F15. 5) 

1003  FORMAT  (///// 10X, •( l-ALFA )  X  100  PERCENTILE  ', 
*'(A  SUB  1  -  ALFA)  EQUALS  ',F15.5) 

1G04  FORMAT  (/////10X, 'STANDARD  DEVIATION  OF  COMPUTED  », 
♦  •LOWER  CONFIDENCE  LIMIT  EQUALS • .F15. 5 ) 

1005  FORMAT  (///// 10X ,' PERCENT ILE  ASSOCIATED  WITH  • 
*'R  SUB  S  EQUALS', F15. 5) 

1006  F0RMAT(////10X, 'MEAN  OF  COMPUTED  LOWER  CONFIDENCE', 
• 'LIMIT  EQUALS'. F15. 5) 

1020  FOPMAT( 1CX. '100C  VALUES  OF  THE  LOWER  CONFIDENCE  ', 
♦•LIMIT.  LISTED  IN  ACCENDING  ORDER') 

1021  F0RMAT(10X, '100C  VALUES  OF  THE  LOWER  CONFIDENCE  ', 
*'LIMIT. LISTED  IN  THE  ORDER  GENERATED') 

1022  FORMATULX, '1000  VALUES  OF  THE  ESTIMATOR  FOR  THE', 
»•  SYSTEM  RELIABILITY  (RHATS)') 

WRITE(6,102C) 

WRITE(6,10C1)A1 

WRITE(6,1C21 ) 

WRITE(6,10Ci)RHATL 

WRITE(6,1022) 

WRITE(6,1001)RHATS 

STOP 

END 
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C  SUBROUTINE  RHAT 

C 

C 

C 

C         SUBROUTINE  RHAT  COMPUTES  THE  VALUES  RHATS 

C  (SYSTEM  RELIABILITY  ESTIMATOR)  AND  RHATL 

C         (LOWER  CONFIDENCE  LIMIT)  USING  AS  ITS 

C         CALLING  PARAMETERS  THE  STATISTICS  GENERATED 

C  IN  PROGRAM  MAIN.   IT  IS  A  STRAIGHTFORWARD 

C         APPLICATION  OF  THE  APPLIED  PHYSICS  LAB- 

C 

C 

C 

COMMON  RUOO)  9  AN(  100)  »S ( 100  ) , PHATL ( 1000 ) , F ( 10 ) , 
*Al ( 1000 ),A2( 1000) ,KK,K 
C 
C 
C         HERE  INITIALIZE  VALUES  AS  NECESSARY 


C 


C 


PIPSQ=1. 

PR0D*1. 

CAPP=1. 


C 

C 

C         HERE  •RHATP  IS  SYBSYSTEM  RELIABILITY  ESTIMATOR 

C 

DO  50C  JA=1,K 

RHATI=S(JA)/AN( JA ) 

PSQ*RHATI*RHATI 
C 
C 

C         HERE  PIPSO  IS  THE  PRODUCT  OF  THE  SQUARED 
C         SUBSYSTEM  ESTIMATORS. 
C 

PIPSQ=PIPSQ*PSQ 
C 
C 

C         THE  PURPOSE  OF  THIS  STATEMENT  IS  TO  PRE- 
C         VENT  EXPONENT  UNDERRUN,  THAT  IS,  IT  PPE- 
C         VENTS  NUMBERS  FROM  GETTING  SMALLER  THAN 
C  THE  COMPUTER  CAN  EFFECTIVELY  HANDLE.  IT 

C  SETS  VERY  SMALL  NUMBERS  EOUAL  TO  ZERO. 

C 

IF(PIPSO-.OOCOOCC1 ) 501,502,502 
501    PIPSQ=0. 

PROD=C. 
C 
C 

C         THIS  STATEMENT  IS  A  CODIFICATION  OF  THE 
C  SECOND  TERM  OF  THE  RIGHT  HAND  SIDF  OF 

C         EQUATION  (5),  CHAPTER  II. 

5C2  PROD=PROD*(PSQ-(RHATM  (l.-RHATI)  )  /  (  AN  (  J  A  )- 1.  )  ) 
CAPP=CAPP*RHATI 

500  CONTINUE 
C 
C 

C         THIS  STATEMENT  IS  A  CODIFICATION  OF  THE 
C         ENTIRE  EQUATION  (5),  CHAPTER  II. 

SIGPSQ=PIPSQ-PROD 

SIGP»SQRT(SIGPSO) 

BALFA»ALF  *20. 

JALFA*BALFA 
C 
C 

C         HERE  COMPUTE  THE  VALUE  OF  THE  LOWER  CONFI- 
C         DENCE  LIMIT,  CALLED  PHA  IN  THIS  SUBROUTINE. 


FHA  «CAPP-(P( JALFA)*S I GP I 
RETURN 
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SUBROUTINE  SHSORT 


SUBROUTINE  SHSORT ( Af KEY ,/N/ ) 
DIMENSION  A(N),KEY(N) 
*l*l 
6  Ml«Ml*2 

IF(Ml-N)  6,6,8 
8  Ml»Ml/2-l 

MM«MAXO(Ml/2,l) 
GO    TO    21 
2C    MM^MM/2 

IF(MM)100,100,21 

21  K=N-MM 

22  DO    1    J  =  1,K 
II«J 

11     IM=II>MM 

IF(A(  IM)-Atim    30,1,1 
3C    TEMP=A(II I 

IT*KEY< II ) 

AC  1 1  )-A(lM) 

KEY(II)=KEY( IH) 

A(IM)=TEMP 

KEY( IM)=IT 

I  1*1 I-HM 

iF(in  1,1,11 

1  CONTINUE 
GO  TO  20 
100  RETURN 
END 
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FUNCTION    SUBROUTINE    RNG 


FUNCTION    RNG(N) 

NR  =  N 

IF(NR)10, 10,20 
10    IX=30517 

NR=NR*1 
20    DO    50    I=1.NR 

IY=IX*65539 

IFUYI5,6,6 

5  IY=IY*2147483647U 

6  RNG=IY 

RNG=RNG*. 46566 13E-9 
50    IXMY 
RETURN 
END 
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13   ABSTRACT 


Systems  which  are  composed  of  two  or  more  phases,  or  subsystems,  arranged  in 
logical  sequence  are  found  frequently  in  industry  and  defense.   Standard  procedures 
for  computing  lower  confidence  limits  on  reliability  of  such  systems  rely  on  the 
use  of  system  data.   Engineering  changes  to  any  of  these  subystems  can  effect  the 
invalidation  of  all  existing  data,  necessitating  additional,  sometimes  extensive, 
testing.   Such  changes  are  not  infrequent  in  complex  systems.   A  need  exists  for 
a  method  of  computing  lower  confidence  limits  on  reliability  which  uses  phase  data. 
Some  approximation  techniques  have  become  available.   One  such  techniaue  is  cur- 
rently being  used  by  Applied  Physics  Laboratory,  The  Johns  Hopkins  University. 
Computer  simulation  techniques  are  used  to  analyze  the  accuracy  of  this  procedure. 
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